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[57] ABSTRACT 

A plastic container sorter (10) moves labeled plastic 
containers (14, 20, 48, 54, 58) of various colors and 
transparencies through an inspection zone (18). A pair 
of line-scanning color cameras (22, 24) capture respec- 
tive transmittance and reflectance images of the con- 
tainers and generate raw transmittance and reflectance 
image data. The raw container data are digitized, nor- 
malized, and binarized to provide accurate transmit- 
tance and reflectance container RGB image data and 
binarized image data for differentiating container image 
data from background data. Container sorting entails 
eroding (120) the binarized transmittance image and 
merging (122) the eroded image with the transmittance 
image data to yield a transmittance image. The eroded 
transmittance image is analyzed (124, 126) to determine 
whether the container is opaque. If the container is 
opaque, color analysis proceeds by analyzing the reflec- 
tance image data. If, however, the container is not 
opaque, transmittance image data are used to classify 
tie container as green transparent (140), translucent 
(142), or clear transparent (142). Classified containers 
are transferred to an ejection conveyor (46). Side dis- 
charge of a classified container is effected by an air 
ejector (64) blast that is timed in response to sensing a 
particular container adjacent to an appropriate side 
discharge station (60). 

17 Claims, 12 Drawing Sheets 
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FIG. 6A 
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FIG. 6B 
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FIG. 6F 




03/19/2004, EAST Version: 1.4.1 



U.S. Patent Aug. 22, 1995 sheet 12 of 12 5,443,164 




03/19/2004, EAST Version: 1.4.1 



5,443,164 

1 2 

articles as either polyethylene terephthalate ("PET") or 

PLASTIC CONTAIN ER S ORTING SYSTEM AND polyvinyl chloride ("PVC"). Color analysis entails 

METHOD using an unacceptably slow mechanically positioned 

color filter technique. Opaque plastic articles are in- 
TECHNICAL FIELD 5 spected with scattered and/or refracted X-rays, a 
This invention relates to inspection and sorting sys- known hazardous technique. The patent does not de- 
terns and more particularly to an apparatus and a scribe how color analysis is accomplished for opaque 
method for inspecting and sorting plastic containers by articles. In any event, proper inspection is said to re- 
combinations of their light transmittance and reflec- quire delabeling or otherwise avoiding labels, but no 
tance characteristics, and for avoiding sorting errors 10 way of avoiding labels is described, 
caused by labels affixed to the containers. tj.s, p a t. No. 4,919,534 for SENSING OF MATE- 
BACKGROUND OF THE INVENTION RIAL OF CONSTRUCTION AND COLOR OF 

_ m . . CONTAINERS describes using two wavelengths of 

Growing environmental awareness has developed a i:„i, f ^ ™ 

market need for recycling plastic items. Such items are * P? lanzed h S ht * determine the composition and color 
made from nonrenewable petrochemical resources, ° f ^f*™* ™ d translucent confers. In particular, 
consume diminishing landfill space, and decompose ***™™B composition as glass or PET and fur- 
very slowly. The market for recycled plastic is cost <her determining color entails calculating a difference m 
sensitive, and its ultimate size, success, and profitability the transmitted intensity for polarized light at each of 
result from the degree to which automated systems can 20 the two wavelengths, normalizing by the sum of the 
sort a wide variety of plastic items and, in particular, transmitted intensities, and using the normalized difFer- 
plastic containers such as beverage bottles. Plastic con- ence as a color index for characterizing the color of the 
tainer sorting has value because containers consume an container. Labels are considered opaque and are, there- 
inordinate portion of landfill volume. fore, ignored. Opaque containers cannot be analyzed by 

Systems and methods are already known for sorting 25 this technique, 

plastic items by size, color, and composition. In particu- U.S. Pat. No. 5,085,325 for a COLOR SORTING 

lar, U.S. Pat No. 5,150,307 for a COMPUTER-CON- SYSTEM AND METHOD, assigned to the assignee of 

TROLLED SYSTEM AND METHOD FOR SORT- this application, describes using line-scanning cameras 

ING PLASTIC ITEMS describes a sorting system in t0 sort moving articles on the basis of reflected RGB 

which baled plastic items, mcluding containers, are 30 colors of visible light. Colorimetric accuracy is ensured 

broken apart into pieces, smgulated on a split belt, and b normalizing the light sensitivity of each camera sen- 

reflectance imaging camera. When the length is known, d ^^ ue l as address mt0 a cok > r looku P 

the center of each item is estimated so that most back- 35 teble ( CLUT) that stores predetermined accept- 

ground data can be elirninated from the RGB reflec- /«J«* ^ta. The CLUT address is an 18-bit word 

tance image to speed up a time-consuming composition formed by concatenating together the six most signifi- 

and color analysis. Reflectance images are subject to 08111 °* ts °f tzch R, G, and B normalized and digitized 

color contamination by labels, so the system performs color data. Such color data are said to be in a three-di- 

an image grid analysis by which an image edge is lo- 40 mensional color space. CLUT output data can be size 

cated and the dominant RGB color is determined for classified by a filter lookup table ("FLUT") and/or 

each grid element located along the image edge. The image processed in an image memory. Statistical- and 

item edge is assumed to include a minimum of color- histogram-based methods for loading the CLUT and 

contaminating label data. Item discharge utilizes a dis- FLUT with accept/reject and filtering data are also 

charge conveyor rx>sition-synchronizing rotopulse, an 45 described. This system is primarily used to detect spot 

item-indicating photoeye, an item-sorting mechanical defects, such as eyes, in opaque articles, such as potato 

distribution gate, and an item-discharging air ejector. strips 

Such a sorting system is costly, overly complex, and what is needed, therefore, is a simple, cost-effective 

prone to unreliability. Spinning items to achieve the plastic co ntain e r sorter that is capable of accurately 

lengthwise ^ onentadon mcreases the probabihty that 50 classifyillg la5eled c„ ntainers 0 f any size, opacity, trans- 

adiacent items can be knocked into misalignment . . _ _ , J 

Length and center determination, coupled witfTback- J™* Color ' 0r orientation. Moreover plastic con- 

grou^d elimination, edge determkaS^ ?v V T^5 ^"*?**f } f me n * C * 

sis, is an overly time-consuming color analys^method "ft*.** fallows them to slip, roll and 

that is subject to edge-induced color errors. Moreover, 55 ^ de dunn « ™ ^ f * 

using only a reflectance image does not provide for 15 needed for ***** e J ectm S classified 

optimal analysis of transparent and translucent items. containers. 

Finally, because they are light and have a variety of SUMMARY OF THE INVENTION 
shapes and sizes, plastic containers tend to float, roll, 

and shift position easily on a conveyor belt Even 60 An object of this mvention is, therefore, to provide an 

though the above-described sorting system can handle apparatus and a method for sorting plastic containers by 

plastic containers, it is needlessly complex, potentially degree of transparency and color, 

unreliable, and therefore not optimally cost effective for Another object of this invention is to provide an 

sorting plastic containers. apparatus and a method for removing edge and label 

U.S. Pat. No. 5,141,110 for a METHOD FOR 65 color contamination from color sorting decisions. 

SORTING PLASTIC ARTICLES describes using A further object of this invention is to provide an 

polarized light and crossed linear polarizers to classify apparatus and a method for accurately sorting moving 

the composition of transparent or translucent plastic articles that are positionally unstable. 
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cost^v^fcolt^s^^g tap^ DETAILED DKCRffTION OF PREFERRED 

sorting speed, accuracy, and reliability. EMBODIMENT 

A sorting apparatus and method according to this A. general description of a plastic container sorter 10 

invention entails moving labeled or unlabeled plastic 5 according to this invention follows with reference to 

containers of various colors and transparencies across FIGS. 1 and 2. A plastic container 12, having a label 14, 

an inspection zone. A pair of line-scanning color cam- " placed on a presentation conveyor 16 for accelera- 

eras capture transinittance and reflectance images of the tion ' stabilization, and propulsion through an inspection 

containers and generate respective raw transinittance zone . . „ , 

and reflectance image data. The raw container image 10 * ^ ntamer ™> a 21, passes 

data are digitized, normalized, processed, and binarized ^ ha ^ 

L . "7 . _ by a reilcctea light-sensing { reflectance i camera 22 

o provide accurate transmittance and reflectance con- ^ a ^^^^.^5 CteStm^)«n> 

^erimagedata together with bmaW era 24 for generation of restive rS^d 

oWerentiatmg container image data from background , 5 trans^ttance video images of plastic container 20 and 

~?" „ label 21. Light from a pair of very-high-output 

Container sorting entails eroding the binarized trans- ("VHO") fluorescent lamps 26 is focused on inspection 
mittance image and merging the eroded image with the zone 18 by associated parabolic reflectors 28. Reflec- 
normalized transmittance image data to yield an eroded tance camera 22 receives light reflected from plastic 
transmittance image that is free of noise and edge color 20 container 20 as it passes through a scanning plane 30. 
effects. The eroded transmittance image is analyzed to Reflectance camera 22 views plastic container 20 
determine whether the container is opaque. If die con- against a nonreflecting dark-cavity background 32. 
tainer is opaque, color analysis proceeds by using the Transmittance camera 24 receives light transmitted 
reflectance image data. The binarized reflectance data through plastic container 20 as it passes through a scan- 
are twice eroded, and the once and twice eroded images 25 plane 34. The transmitted light originates from an 
combined to yield a binary trace ring. The binary trace iUuminated background 36. Line scanning cameras 22 
ring is merged with the normalized reflectance image 311(1 2* generate respective reflectance and transmit- 
data to yield a color trace ring that is free from noise, streams while plastic container 20 
color edge effects, and most label color contamination. inspection zone 18. By the time plastic 
The opaque container color is the average RGB color 30 fo**™* 20 enters * transfer chute 38, sufficient video 
of the color trace ring. If, however, the container is not ^ta have been generated to capture and process a re- 
opaque, normalized transmittance image data are used fle5 f? ce ™* ge 311(3 a transmittance image of plastic 
to clarify the container as green transparent, translu- "T"" 20 * res ^ ve ™jp processors 40 and 42. 
ppnt rtr LJirZ n£Zl t transparent, iransiu image processors 40 and 42 receive the reflectance 
cent, or clear transparent. 35 and transmittance video as serial bit streams of ampli- 

Classified containers are transferred to an ejection mde modulated , repeating cycles of, red ("R")> green 

conveyor having multiple side discharge stations hav- ^ blue ^..j bits# re flectance and trans- 

mg associated container sensors and air ejectors. Side mittance RGB bit streams are each digitized, amplitude 

discharge of a particular classified container is effected normalized, sorted into RGB color components, and 

by an air ejector blast that is timed in response to sens- 40 built into RGB and binarized images for transparency 

ing the particular container adjacent to the appropriate and color analysis by a general purpose processor 44. 

side discharge station. General purpose processor 44 receives RGB reflec- 

Additional objects and advantages of this invention tance image data and binary reflectance image data 

will be apparent from the following detailed description from reflectance image processor 40 and receives RGB 

of a preferred embodiment thereof which proceeds with 45 transmittance image data and binary transmittance 

reference to the accompanying drawings. image data from transmittance image processor 42. A 

~™™™~.™ ~ container sorting program processes the transmittance 

BRIEF DESCRIPTION OF THE DRAWINGS data to determine whether container 20 is opaque. If 

FIG. 1 is a simplified schematic side elevation view of container 20 is opaque, the sorting program processes 

a plastic container sorter according to this invention. 50 ^ reflectance data to determine the container color. 

FIG. 2 is a simplified isometric pictorial view of a 00101 contamination from label 21 is avoided by the 

plastic container sorter according to this invention. sorting program If container 20 is not opaque, the 

FIG. 3 is a fragmentary simplified isometric pictorial transmittance data are further processed to determine 

view of a container being inspected in an inspection wh *her container 20 is green transparent, translucent, 

zone of the plastic container sorter according to this 55 or clear transparent. General purpose processor 44 asso- 

invention ciates the proper sorting classification with container 20 

FIG. 4 is a simplified schematic block diagram show- enters these data into a container sorting queue. 

F " " ^T.T 6 . An ejection conveyor 46 transports previously ana- 

mg an image processor Recording to this invention^ lyzed ^ tttainers 43, ^ 52> ^ J d « ^J^l a 

FIG 5 is a flow chart showing the processing steps a ^ of ejection stations 60 each having a pair of photo- 
executed to sort plastic containers according to this electric container sensors 62 and associated ejectors 
m ^?° n * . ■ m 64. When a particular photoelectric container sensor 62 

FIGS. 6A-6F are pictorial representations of plastic senses a container, an associated bit is set in a container 

container digital image data taken at various points in sensor register 66. Likewise, a particular air ejector 64 is 

the processing steps indicated in FIG. 5. 65 actuated in response to an associated bit being set in a 

FIG. 7 is a fragmentary simplified isometric pictorial container ejector register 68. Container sensor register 

view of a container being ejected off an ejection con- 66 and container ejector register 68 are electrically 

veyor according to this invention. connected to general purpose processor 44. The con- 
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tainer sorting queue is flushed in response to signals 34 measures 0.4 by 30.5 centimeters. Up to one hundred 
from container sensor register 66 such that appropriate successive scans are used to scan adjacent 0.4 centime- 
ones of air ejectors 64 are actuated at the correct times ter sections of plastic container 20 as it passes through 
to eject previously analyzed containers from ejection viewing zone 18. Sufficient image data are collected to 
stations 60 into appropriate collection bins 70. 5 store a 75 by up to 100 triad image of an object, such as 

The foregoing general description of plastic con- plastic container 20, passing through viewing zone 18. 
tainer sorter 10 proceeds in more detail with reference The effective image size is, therefore, 30.5 by up to 40.5 
to FIG. 3. centimeters. 

Presentation conveyor 16 moves in a direction indi- Another problem with triad-based color cameras is 
cated by an arrow 80 at a fixed rate ranging from 30 to 10 that certain CCD array chips have differing signal out- 
213 meters per minute, with the preferred rate being 152 put values between odd- and even-numbered elements, 
meters per minute. Presentation conveyor 16 is prefera- For example, every other triad may have high-red, 
bly 30.5 centimeters wide and has a surface tilt angle 82 low-green and high-blue values, whereas the other (in- 
in a range of from 5 to 20 degrees, with the preferred terleaved) triad may have low-red, high-green and low 
angle being 7.5 degrees. Surface tilt angle 82 is defined 15 blue values. Alternating color distortion results if all 
as the angle formed between an imaginary horizontal triads are used to generate an image. Because plastic 
line 84 and an imaginary line 86 intersecting the planar container sorter 10 uses triads spaced apart by three 
surface of presentation conveyor 16 in a direction trans- unused triads, alternating color distortion is eliminated, 
verse to arrow 80. A slick side barrier 86, preferably Any odd-numbered triad spacing would also eliminate 
TEFLON ®, is mounted adjacent to an elevationally 20 alternating color distortion. 

lower side margin 88 of presentation conveyor 16. Slick Cameras 22 and 24 are each fitted with a NIKON 50 
side barrier 86 provides orientation stability for round millimeter f:1.4 lens set to an £2.8 aperture value. Expo- 
containers placed on presentation conveyor 16. The sure time for each camera scan is 1.5 milliseconds. Focal 
angular orientation of plastic container 20 in inspection plane to viewing zone 18 distance is preferably 130 
zone 18 is not important, but its orientation change is 25 centimeters. Suitable lenses are available from NIKON 
limited to no more than 0.5 degree in any axis per centi- OEM Sales, Diamond Bar, Calif, 
meter of travel through inspection zone 18. Viewing zone 18 requires about 550 foot-lamberts of 

Reflectance camera 22 and transmittance camera 24 illumination for reflectance camera 22 to properly ex- 
each are of a linear CCD array scanning type such as pose its CCD array under the foregoing exposure con- 
model TL-2600 manufactured by PULNIX America, 30 ditions. Sufficient iUumination is provided by using a 
Inc., Sunnyvale, California. Cameras 22 and 24 each pair of parabolic reflectors 28 to focus light propagating 
have a single linear array of 2592 CCD elements incor- from associated VHO fluorescent lamps 26 on viewing 
porating repeating groups of alternating R, G, and B zone 18, Each of VHO lamps 26 is a 122 centimeter 
light wavelength filters. Each group of three CCD long, VHO daylight fluorescent bulb driven by an opti- 
elements with respective R, G, and B filters is referred 35 cally regulated power supply such as model FXC- 
to as a triad. Cameras 22 and 24 have 864 triads in the 16144-2 manufactured by Mercron, Inc., Richardson, 
2592 element array and provide a cost-effective solution Texas. Each of VHO lamps 26 is bent into three linear 
for many full color visible spectrum imaging applica- sections including a center linear section and two end 
tions. linear sections, each 41 centimeters long. The lamps are 

Unfortunately, triad-based color cameras have an 40 bent by techniques well known in the neon sign indus- 
"edge effect" problem that causes color shifts at the try. Each of the end sections is bent about 25 degrees 
edges of images scanned by such a camera. The edge relative to the longitudinal axis of the center section and 
effect is caused whenever the CCD array receives a such that the longitudinal axes of all sections are co-pla- 
light wavelength transition, such as that from a con- nar. 

tainer edge. If the light wavelength transition is opti- 45 Each of parabolic reflectors 28 is fabricated by join- 
cally imaged on only a portion of a triad, then only ing a center linear parabolic section and two end linear 
those RGB elements that are imaged will generate a parabolic sections at an angle matching that of VHO 
signal. For example, if a transition from black to red is lamps 26. VHO lamps 26 are positioned within para- 
imaged on only the G and B elements of a triad, no red bolic reflectors 28 such that their respective longitudi- 
signal will be generated. If a transition from white to 50 nal axes and lines of focus coincide, 
black is imaged on only the R element of a triad, only a A preferred distance of about one meter between 
red signal will be generated. Clearly, accurate color VHO lamps 26 and viewing zone 18 provides uniform 
signal generation depends on edges being imaged on all illumination of an adequately large scanning area to 
elements of a triad. accommodate a large range of container sizes. 

Plastic container sorter 10 reduces edge effects by 55 Dark-cavity background 32 is a 92 centimeter long by 
using data from only every fourth triad and defocusing 31 centimeter high box that tapers in width from 8 centi- 
the camera to enlarge the effective pixel diameter by 10 meters at its base to 4 centimeters at its open top. All 
times. This increases image overlap within each triad to interior surfaces are a flat black color to provide a re- 
greater than 95 percent but does not degrade effective flectance of less than 2 percent to visible light having 
image focus, because the triads used are spaced apart by 60 wavelengths ranging from 400 to 700 nanometers. The 
12 pixels. reinaining reflectance is lambertion in nature. Dark- 

The effective resolution of cameras 22 and 24 is such cavity background 32 is preferably positioned 92 centi- 
that each triad receives light from a 0.4 by 0.4 square meters beneath viewing zone 18 and is aligned to en- 
centimeter area in viewing zone 18. In each camera, close a terminal portion 90 of reflectance scanning plane 
image data from the center-most 75 actually used triads 65 30. 

are used to store an image of viewing zone 18. Data Light propagating from illuminated background 36 is 
from other triads are ignored. Therefore, the portion of transmitted through container 20 in viewing zone 18 to 
viewing zone 18 intersected by scanning planes 30 and transmittance camera 24. Illuminated background 36 is 
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preferably an 8 centimeter wide by 122 centimeter long tion zone 18 generates a stream of sequential raw video 
white Ught-diffusing panel that is illuminated by a 122 data values that are digitized by ADC 102, unity multi- 
centimeter long VHO daylight fluorescent lamp 92 plied by digital multiplier 104, and stored in a set of 
driven to approximately 80 percent of maximum bright- sequential data locations in a pixel RAM 108. The raw 
ness by an optically regulated power supply such as 5 video data values stored in pixel RAM 108 are read by 
Mercron Ballast Model HR 2048-2. A glare shield 5)4 general purpose processor 44 and compared with a 
prevents stray light from VHO lamp 92 from entering preferred standard data value of 220 (decimal equiva- 
reflectance camera 22. Illuminated background 36 is lent of stored binary value). General purpose processor 
preferably positioned at least one meter above viewing 44 calculates the difference between the raw data values 
zone 18 and is aligned such that its long axis coincides 10 and the standard data value and calculates a multiplica- 
with a terminal portion 96 of transmittance scanning tion factor for each raw data value. General purpose 
plane 34. Such a positioning accommodates the passage processor 44 completes the calibration process by stor- 
of oversized containers through viewing zone 18 and ing the calculated multiplication factors in gain RAM 
minimizes the possibility of stray light from VHO lamps 106 at locations associated with each raw data value. 
26 being reflected off bright container surfaces, to illu- 15 Normalization subsequently proceeds when digital 
minated background 36, and into transmittance camera multiplier 104 receives on set A of input terminals a 
24. sequence of raw data values. As each sequential raw 
Objects in viewing zone 18, such as container 20, are data value is received, the multiplication factor associ- 
readily classified as opaque, translucent, or transparent ated with each data value is received from gain RAM 
when scanned by transmittance camera 24 against illu- 20 106 at set B of input terminals of digital multiplier 104. 
minated background 36. Opaque objects, including Digital multiplier 104 generates, at a set A X B of output 
label 21, are easily classified by comparing the light terminals, normalized data values that are stored in pixel 
intensities received by transmittance camera 24 from RAM 108 and which are used to address locations in a 
illuminated background 36 and the object in viewing pixel lookup table ("PLUT") 110. 
zone 18. An object that transmits no more than about 25 The normalized eight-bit data values stored in pixel 
ten percent of the light received from illuminated back- RAM 108 are read by general purpose processor 44, 
ground 36 is indicative of an opaque object. An object assembled into 24-bit RGB triad data values, and stored 
that transmits between about ten and 30 percent of the by general purpose processor 44 as transmittance RGB 
light received from illuminated background 36 is indica- image data. 

tive of a translucent object Classification of objects is 30 Binarization of the normalized eight-bit data values 

described below in more detail with reference to FIGS. provides for differentiating container data from back- 

5 and 6. ground data. Binarization of transmittance data entails 

Cameras 22 and 24 generate respective reflectance prograrnming a logic-0 state into PLUT 110 of transmit- 

and transmittance video data streams that are each digi- tance image processor 42 at all storage locations having 

tized, normalized, and binarized by respective reflec- 35 addresses ranging from 210 to 230 and a logic-1 state 

tance and transmittance image processors 40 and 42. into storage locations having addresses 0 through 209 

Image processors 40 and 42 function as described here- and 231 through 255. Accordingly, all normalized 

after with reference to FIG. 4. Only the processing of eight-bit data values presented to PLUT 110 that are 

transmittance video data by transmittance image pro- within 10 units of 220 are background data values, and 

cessor 42 will be described because image processors 40 40 the others are object data values, 
and 42 are substantially identical. In similar manner, binarization of reflectance data 

Tra nsm ittance video data enters transmittance image entails programming a logic-0 state into PLUT 110 of 

processor 42, is conditioned by a video amplifier 100, reflectance image processor 40 at all storage locations 

and digitized to eight bits by an analog-to-digital con- having addresses ranging from 0 to 10 and a logic-1 

verter ("ADC") 102. The digitized transmittance video 45 state into storage locations having addresses 11 through 

data are a sequential stream of alternating red, green, 255. 

and blue raw eight-bit data values that enter an 8X 8 PLUT 110 generates a logic-0 bit in response to each 

digital multiplier 104 at a set A of input terminals for background data value and a logic-1 bit in response to 

normalization. Normalization is a well-known process each object data value. Each normalized data value 

by which sensitivity differences associated with each 50 generates a corresponding bit that is shifted into an 

CCD element in camera 24 are equalized. eight-bit shift register 112 that functions as a serial-to- 

However, normalization first requires that a calibra- parallel converter. For each bit shifted into eight-bit 
tion process be carried out without any objects in view- shift register 112, a corresponding eight-bit parallel data 
ing zone 18. Calibration entails comparing a raw data byte is formed that is stored in a window RAM 1 14. 
value associated with each CCD element in camera 24 55 As was stated earlier, RGB data triads are formed 
with a standard data value, calculating a difference from groupings of three sequential data values. There- 
value for each CCD element, and storing in a memory fore, if any bit, in a group of three sequential bits, that is 
a compensating multiplication factor for each CCD generated by PLUT 110 is a logic-1, me associated triad 
element. is an object triad. If all three sequential bits generated 

During subsequent operation, each raw data value is 60 by PLUT 100 are logic-0, the triad is a background 

multiplied by its associated multiplication factor to pro- triad. This determination is made by a window lookup 

vide a normalized data value. table ("window LUT") 116 that is programmed to logi- 

Image processor 42 starts the calibration process by cally OR the first three bits of each data byte formed by 

receiving from general purpose processor 44 a com- eight-bit shift register 112 as each byte is stored in win- 

mand that initializes all storage locations in a gain RAM 65 dow RAM 1 14. Accordingly, if the output of window 

to a unity value. The 8X8 digital multiplier 104 receives LUT 116 is a logic- 1, the most recent three bytes repre- 

the values stored in gain RAM 106 at a set B of input sent an object triad. Otherwise, if the output of window 

terminals. A scan by transmittance camera 24 of inspec- LUT 116 is a logic-0, the most recent three bytes repre- 
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sent a background triad. The binarized data generated 
by window LUT 116 is routed by general purpose pro- 
cessor 44 to a memory. 

By way of example, Table 1 shows representative 
data undergoing the foregoing signal processing steps. 5 
Container edge transmittance image data from transmit- 
tance camera 24 CCD elements 1187 through 1250 are 
shown making a transition from a semi-transparent 
green value to a background value. Bold highlighted 
data rows indicate every fourth RGB triad that is pro- 10 
cessed by general purpose processor 44. Of the 75 triads 
used, data from triads numbered 28 through 33 are 
shown. Unused triads are so indicated. Column three 
shows the normalized data values associated with each 
CCD element The normalized data values are pro- 15 
cessed by PLUT 110 and stored in pixel RAM 108. 
Column four shows the data bit states generated by 
PLUT 110. 

The data in Table 1 are ordered with the most recent 
data shown at the bottom, i.e., CCD element number 20 
1187 is processed first and CCD element number 1250 is 
processed last. Column five shows the data bytes 
formed in shift register 112 in response to each bit re- 
ceived from PLUT 110. The data bytes are shown eight 
bits delayed relative to the data bits received from 25 
PLUT 110 as shown in column four. The right-most 
three underlined data bits are those logically ORed by 
window LUT 116 to make a data binarization decision. 
Column six shows the output of window LUT 116 with 
indicating the data bits processed by general purpose 30 
processor 44 to store a binarized transmittance image. 
Note that the data bit is used because the underlined bits 
in shift register 112 contain data associated with the 
current RGB triad. 

35 

TABLE 1 



10 

TABLE 1 -continued 



CCD 


RGB 


Pixel RAM 


Pixel 


Shift 


Window 


Element 


Triad 


Normalized 


LUT 


Register 


LUT 


No. 


No. 


Data Value 


Output 


Contents 


Output 


1223 


31(B) 


132 




mum 


{1} 


1224 


31(R) 


110 


1 


mum 


1 


1225 


31(G) 


188 


I 


mum 


1 


1226 


unused(B) 


128 


1 


in mil 


1 


1227 


uuused(R) 


108 


I 


mum 


1 


1228 


unused(G) 


184 




mum 


1 


1229 


unused(B) 


121 


1 


mum 


1 


1230 


umised(R) 


105 




mum 


1 


1231 


unused(G) 


177 


1 


mum 


1 


1232 


unused (B) 


117 


I 


mum 


1 


1233 


unused(R) 


099 


1 


limm 


1 


1234 


unused(G) 


173 


1 


mum 


1 


1235 


32(B) 


111 


1 


mum 


{1} 


1236 


32(R) 


097 


1 


mum 


1 


1237 


32(G) 


167 


1 


mum 


1 


1238 


unused (B) 


113 




mmii 


1 


1239 


onused(R) 


096 




mum 


1 


1240 


unused(G) 


169 




mum 


1 


1241 


uzrased(B) 


112 




31111111 


I 


1242 


unused(R) 


095 




mum 


1 


1243 


unused(G) 


172 




uium 


1 


1244 


unused (B) 


UO 




mum 


1 


1245 


unused(R) 


097 




mum 


1 


1246 


unused(G) 


168 




mum 


1 


1247 


33(B) 


112 




mum 


{1} 


1248 


33(R) 


096 




mum 


1 


1249 


33(G) 


170 




mum 


1 


1250 


unused (B) 


111 




mum 


1 



CCD 


RGB 


Pixel RAM 


Pixel 


Shift 


Window 


Element 


Triad 


Normalized 


LUT 


Register 


LUT 


No. 


No. 


Data Value 


Output 


Contents 


Output 


1187 


28(B) 


220 


0 


00000000 


{0} 


1188 


28(R) 


221 


0 


00000000 


0 


1189 


28(G) 


218 


0 


00000000 


0 


1190 


unused(B) 


216 


0 


00000000 


0 


1191 


unused (R.) 


219 


0 


00000000 


0 


1192 


unosed(G) 


220 


0 


00000000 


0 


1193 


unused(B) 


217 


0 


00000000 


0 


1194 


unused (R) 


217 


0 


00000000 


0 


1195 


unused(G) 


219 


0 


10000000 


0 


U96 


unused (B) 


215 


0 


11000000 


0 


1197 


unused (R) 


217 


0 


ouooooo 


0 


1198 


unused(G) 


221 


0 


11011000 


0 


1199 


29(B) 


214 


0 


11011000 


{0} 


1200 


29(R) 


215 


0 


01101 100 




1201 


29(G) 


219 


0 


10110110 




1202 


unused(B) 


209 




1101 1011 




1203 


unused(R) 


207 




01101 101 




1204 


unused(G) 


217 




10110110 




1205 


unused (B) 


202 




1101 101 1 




1206 


unused (R) 


201 




0U0U01 




1207 


unused(G) 


215 




101101 10 




1208 


unused (B) 


197 




UOUOll 




1209 


unused (R) 


194 




11101101 




1210 


unused(G) 


214 




11110110 




1211 


30(B) 


190 




11111011 


{1} 


1212 


30(R) 


185 




11111101 




1213 


30(G) 


211 




uuiuo 




1214 


unused (B) 


182 




mum 




1215 


unused (R) 


165 




mmii 




1216 


unused(G) 


204 




mum 




1217 


unused (B) 


157 




mum 




1218 


unused(R) 


147 




nimn 




1219 


unused(G) 


199 




H1111I1 




1220 


unused(B) 


143 




mum 




1221 


unused(R) 


136 




mum 




1222 


unused(G) 


193 




mum 





40 
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General purpose processor 44 receives normalized 
and binarized image data from transmittance image 
processor 42 and reflectance image processor 40. FIG. 
5 shows the processing steps executed by general pur- 
pose processor 44 to classify objects such as container 
20 into transparency and color categories. The ensuing 
steps are preferably executed as a C-language program 
by a conventional 50 MegaHertz 486 microprocessor. 
Such a processor and program combination is capable 
of processing containers propelled through inspection 
zone 18 at the preferred 152 meter per minute rate. 
Skilled workers knowing the following processing steps 
can readily provide an appropriate program. 

An erosion process 120 receives the binarized image 
data from transmittance image processor 42 for erosion 
by a diamond-shaped structuring element fitting within 
a three-by-three square area of data. Erosion is a process 
by which data bits not overlaying a predetermined 
structuring shape are erased. Erosion removes "noisy" 
and edge image data to further reduce edge effects. 

A data merging process 122 receives from erosion 
process 120 the eroded binarized image data and com- 
bines them with the normalized RGB transmittance 
image data from transmittance image processor 42 to 
generate eroded and normalized RGB transmittance 
image data with the background data removed. In other 
words, merging process 122 filters out all data except 
for nonedge container data. 

A histogram process 124 accumulates the quantity of 
each unique intensity value ((R+G-f B)/3) received 
from merging process 122 to build a light intensity his- 
togram curve for light transmitted through container 
20. 

A decision process 126 determines whether the "dark 
area" under die histogram curve exceeds a user-deter- 
mined percentage, preferably 90 percent, of the total 
container area. 
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If decision process 126 yields a "yes" answer, con- preferably 36 centimeters wide by 9.1 meters long, 
tainer 20 is opaque and the following color analysis moves in a direction indicated by arrow 150 at a rate of 

process is executed. 152 meters per minute, and has eight ejection stations 

FIGS. 6A through 6F are representative processed 60. 
images of container 20 shown at respective points A 5 Belt movement rate is used as a coarse container 

through F of the ensuing color analysis process. tracking parameter. Other container tracking parame- 

An erosion process 128 receives the binarized image ters used by general purpose processor 44 include the 
data (point B) from reflectance image processor 40 for distances along ejection conveyor 46 to each air ejector 
erosion by a diamond-shaped structuring element fitting $4, a holdoff time for each air ejector, and an actuation 

within a three-by-three square area of data. 10 duration time for each air ejector. Each air ejector 64 

A temporary image buffer 130 saves the eroded includes two separately controllable nozzles 152 that 

image (point Q. arc aimed sUghtly upward to lift containers off ejection 

An erosxon process 132 receives the once-eroded conveyor 46 during ejection, 

binarized image data (point C) from erosion process 128 Fine container tracking is necessary to account for 

and erodes it a second time with a diamond-shaped 15 unpredictable container rate of travel through inspec- 

structunng element fitting within a three-by-three tion rone 18 and transfer chute 38 and because of possi- 

square area of data (point D) We shifting, floating, and rolling of containers on ejec- 

A logical process 134 exclusively-^ the doubly don w ^ Fjne fe ^ 

f^ r^fr^ D) ^ e 0nCe ,? rOded by pairs of oppositely facing photoelectric sensors 62 

ZTf^Tv? 8 ^ ™ S ^ that^ mummated by complementary opposite pairs of 

vpoini Ct). light sources 154 

A data merging process 136 receives the binary trace a ' - , * . . _ , 

ring image data from logical process 134 (point E) and JtJZ^J^ * P^^P^/f 

combinei it with the normalized RGB reflectance J*** 1 c f 2 .f d h f* 154 » ***** 

image data from reflectance image processor 40 (point 25 a rekted to lts P r0 ^ e ' transparency, and rate. 

A). Data merging process 136 generates an RGB oolor ****?* P^f* Processor 44 uses the container profile 

trace ring including normalized RGB reflectance image dy m *>™™** rcflcctanc « image data 

data with the background, edge, and center data (in- ^ f™ 5 next adjacent air ejector 64 at a time 

eluding most label data) removed (point F). *? d for a ***** sufficient to eject the container. Air 

An averaging process 138 determines the average R, 30 blasts m preferably tuned to strike a central portion of 

G, and B color data values in the color trace ring. ^ container. 

The process is ended. Container 20 is opaque and has Coarse and fine container tracking is coordinated 

the RGB color determined by averaging process 138. container sorting queue and tracking parame- 

If, however, decision process 126 yields a "no" an- ters b y general processor 44. Preferred container sort- 

swer, container 20 is not opaque and the following 35 categories for ejection stations 60 include: translu- 

process is executed. cent ; clear transparent; green transparent; red, orange, 

A decision process 140 receives R and G data from or veUow opaque; blue or green opaque; dark opaque; 

data merging process 122 and determines whether the and white opaque. Unidentifiable containers travel off 

green data values are at least a user determined percent- ^ e en ^ °f ejection conveyor 46. 

age, preferably ten percent, greater than the red data 40 Skilled workers will recognize that alternate embodi- 

values. If decision process 140 yields a "yes" answer, nients exist for portions of this invention. For example, 

container 20 is green transparent and the process is cameras other than line scanning types having sequen- 

ended. tial RGB CCD element triads may be used, as may light 

If, however, decision process 140 yields a "no" an- wavelengths other than RGB. Logic states may be in- 

swer, container 20 is not opaque or green transparent, 45 verted from those described, provided the equivalent 

and a decision process 142 analyzes the histogram data logical function is performed. Image processing may 

generated by histogram process 124. Decision process entail other than the described structuring elements, and 

142 compares the "light" histogram area to the "medi- a three-dimensional lookup table could be substituted 

urn-light" histogram area to decide if container 20 is for window RAM 114 and window LUT 116. General 

translucent or transparent. The light area of the histo- 50 purpose processor 44 could be one of many processor 

gram curve is slightly below a "bright background" types, and the sorting program executed thereon could 

value, whereas the medium-light area is much farther be written in a wide variety of programming languages 

below the bright background value. If the medium-light including assembler. Alternatively, the sorting program 

area is at least a user determined percentage, preferably could be implemented with discrete logic components. 

65 percent, of the total light area, decision process 142 55 A histogram process or a color lookup table would be 

yields a "yes" answer, indicates that container 20 is suitable substitutes for averaging process 138. 

translucent, and ends the process. It will be obvious to those having skill in the art that 

Otherwise, decision process 142 yields a "no" an- many changes may be made to the details of the above- 
swer, indicates that container 20 is clear transparent, described embodiment of this invention without depart - 
and ends the process. 60 ing from the underlying principles thereof. Accord- 
General purpose processor 44 associates the proper ingly, it will be appreciated that this invention is also 
sorting classification with container 20 and enters these applicable to containers without labels affixed to them 
data into a container sorting queue. Sorting classifies- and to inspection and sorting applications other than 
tion data associated with each scanned and analyzed those found in plastic container sorting. The scope of 
container is added to the container sorting queue. 65 the present invention should be determined, therefore, 

FIG. 7 shows an enlarged portion of ejection con- only by the following claims, 

veyor 46 in the region of ejection station 60, shown We claim: 

ejecting container 54 (FIG. 2). Ejection conveyor 46 is 1. A plastic container sorting apparatus, comprising: 
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a presentation conveyor moving in a first direction 
and downwardly tilted in a second direction trans- 
verse to the first direction such that the plastic 
containers placed on the presentation conveyor 
tend to move in the second direction toward a 5 
stationary side barrier that stabilizes an orientation 
of the plastic containers as they are propelled by 
the presentation conveyor through an air space 
forming an inspection zone; 

a first video camera receiving reflected light from the 10 
plastic containers in the inspection zone and gener- 
ating a stream of reflectance image data; 

a second video camera receiving light transmitted 
through the plastic containers in the inspection 
zone and generating a stream of transmittance 15 
image data; and 

a processor classifying translucent ones of the plastic 
containers into translucency categories in response 
to the transmittance image data and opaque ones of 
the plastic containers into color categories in re- 20 
sponse to the reflectance image data. 

2. The apparatus of claim 1 further comprising an 
ejection conveyor that receives the plastic containers 
from the inspection zone and ejects the classified plastic 
containers from predetermined locations of the ejection 
conveyor, each of the predetermined locations being 
associated with one or more of the translucency and 
color categories. 

3. The apparatus of claim 1 in which the first video 3Q 
camera has a reflectance scanning plane that terminates 

in a dark cavity background. 

4. The apparatus of claim 1 further comprising: 

an illumination light source illuminating the plastic 
containers in the inspection zone, the illumination 35 
light source being the source of the reflected light 
received by the first video camera; 

a background light source producing background 
light in the inspection zone, the background light 
source being the source of transmitted light re- 40 
ceived by the second video camera; and 

a reflectance image data processor and a transmit- 
tance image data processor normalizing and bina- 
rizing the respective streams of reflectance and 
transmittance image data. 45 

5. The apparatus of claim 4 in which the illumination 
light source comprises a fluorescent lamp bent in multi- 
ple linear coplanar segments and positioned in a focal 
axis of a parabolic reflector. 

6. The apparatus of claim 1 in which the tilt of the 50 
presentation conveyor ranges from about 5 degrees to 
about 20 degrees relative to a horizontal line. 

7. The apparatus of claim 1 in which the side barrier 
has a slick surface. 

8. The apparatus of claim 1 in which the first and 55 
second video cameras are of a linear charge-coupled 
device array, line-scanning type each camera having a 
single linear array of charge-coupled device elements in 
which adjacent triads of charge-coupled device ele- 
ments are sensitive to red, green, and blue wavelengths 60 
of light, and in which the processor employs nonadja- 
cent ones of the triads to eliminate a color distortion in 
the respective streams of reflectance and transmittance 
image data. 

9. The apparatus of claim 1 in which the stream of 65 
reflectance image data includes label data and edge 
data, and in which the processor twice erodes selected 
portions of the reflectance image data to generate color 
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trace ring data that exclude the edge data and most of 
the label data. 

10. In a plastic container sorter a method of acquiring 
and processing image data, comprising the steps of: 

receiving transmittance and reflectance image data 
representative of the plastic container; 

processing the transmittance data to determine 
whether the plastic container is one of substantially 
transparent, substantially translucent, and substan- 
tially opaque; 

processing the reflectance data if the plastic container 
is substantially opaque to determine a reflected 
color of the plastic container; and 

processing the transmittance data further if the plastic 
container is one of substantially transparent and 
substantially translucent to determine whether the 
plastic container is a substantially green transmit- 
ted color. 

11. The method of claim 10 in which the plastic con- 
tainer is one of substantially transparent and substan- 
tially translucent, and is not a substantially green trans- 
mitted color, further comprising the step of analyzing 
the processed transmittance data to determine whether 
the plastic container is one of translucent and a clear 
color. 

12. The method of claim 11 further comprising the 
step of classifying the plastic container into a sorting 
category based on at least one of an opacity value, a 
translucency value, a transmitted color, and a reflected 
color of the plastic container. 

13. The method of claim 10 in which the transmit- 
tance data processing step includes the steps of: 

normalizing, binarizing, and eroding the transmit- 
tance data; 

merging the normalized, binarized, and eroded trans- 
mittance data with the transmittance data to pro- 
vide merged transmittance data; and 

analyzing the merged transmittance data to determine 
a degree of opacity for the plastic container. 

14. The method of claim 10 in which the reflectance 
data processing step includes the steps of: 

normalising and binarizing the reflectance data; 
generating binary trace ring data twice eroding the 

normalized and binarized reflectance data; 
merging the binary trace ring data and the reflectance 

data to generate color trace ring data; and 
analyzing the color trace ring data to determine a 

reflected color of the plastic container. 

15. A plastic container sorting apparatus, comprising: 
a presentation conveyor moving the plastic contain- 
ers through an inspection zone; 

an illumination light source illuminating the plastic 
containers in the inspection zone to provide a 
source of reflected light; 

a first video camera receiving the reflected light from 
the plastic containers and generating a stream of 
reflectance image data; 

a background light source having a white light dif- 
fuser and a glare shield, the white light diffuser 
providing a source of background light that is 
transmitted through the plastic containers, and the 
glare shield preventing stray light from the back- 
ground light source from being detected by the 
first video camera; 

a second video camera having a transmittance scan- 
ning plane that terminates on the white light dif- 
fuser such that the second video camera receives 
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the light transmitted through the plastic containers 
and generates a stream of transmittance image data; 

a reflectance image data processor normalizing and 
binahzing the stream of reflectance image data to 
classify the plastic containers into color categories 5 
in response to the reflectance image data; and 

a transmittance image data processor normalizing and 
binarizing the stream of transmittance image data 
to classify the plastic containers into opacity cate- 
gories in response to the transmittance image data. 10 

16. A plastic container sorting apparatus, comprising: 

a presentation conveyor moving the plastic contain- 
ers through an inspection zone; 

an illumination light source illuminating the plastic l5 
containers in the inspection zone to provide a 
source of reflected light; 

a first video camera receiving the reflected light from 
the plastic containers and generating a stream of 
reflectance image data; 20 

a background light source having a white light dif- 
fuser providing a source of background light that is 
transmitted through the plastic containers; 

a second video camera having a transmittance scan- 
ning plane that terminates on the white light dif- 2s 
fuser such that the second video camera receives 
the light transmitted through the plastic containers 
and generates a stream of transmittance image data; 

a reflectance image data processor norrnalizing and 
binarizing the stream of reflectance image data to 30 
classify the plastic containers into color categories 
in response to the reflectance image data; and 



a transmittance image data processor normalizing and 
binarizing the stream of transmittance image data 
to classify the plastic containers into opacity cate- 
gories in response to the transmittance image data. 

17. A plastic container sorting apparatus, comprising: 

a presentation conveyor moving the plastic contain- 
ers through an inspection zone; 

a pair of scanning cameras generating respective re- 
flectance and transmittance image data streams in 
response to light received from the plastic contain- 
ers in the inspection zone, the reflectance image 
data including container profile data; 

a processor classifying the plastic containers into 
sorting categories in response to the transmittance 
and reflectance image data streams; 

a substantially smooth surfaced ejection conveyor 
moving at a rate, receiving the plastic containers 
from the inspection zone, and conveying the plastic 
containers to predetermined locations adjacent to 
the ejection conveyor, each of the predetermined 
locations being associated with one or more of the 
sorting categories; and 

a photoelectric sensor positioned adjacent to at least 
one of the predetermined locations, the sensor gen- 
erating a container tracking signal that the proces- 
sor processes together with the rate and the con- 
tainer profile data to eject particular classified ones 
of the plastic containers from the predetermined 
location by directing an air ejector blast at a central 
portion of the particular classified ones of the plas- 
tic containers. 
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